Imaging apparatus, and control method and control program therefor

ABSTRACT

A finder display unit displays a live view image based on a captured image generated by an imaging unit. A digital signal processing unit detects a movement vector between frames in the live view image for a predetermined portion in the captured image. A digital signal processing unit changes a display range of the live view image on the finder display unit based on the detected movement vector of a peripheral portion in the captured image.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of PCT International Application No.PCT/JP2018/035884 filed on 27 Sep. 2018, which claims priority under 35U.S.C § 119(a) to Japanese Patent Application No. 2017-188042 filed on28 Sep. 2017. The above application is hereby expressly incorporated byreference, in its entirety, into the present application.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to an imaging apparatus, and a controlmethod and a control program therefor.

2. Description of the Related Art

In general, an imaging apparatus, such as a digital camera, comprises afinder unit that allows a photographer to look through an eyepiecewindow to confirm the subject image, in addition to a rear display unitprovided on a rear surface of the camera body. As the finder unit, anelectronic view finder in which a live view image is displayed on afinder display unit disposed at the back of an eyepiece optical systemis known.

Since such an electronic view finder observes the live view imagemagnified by the eyepiece optical system, visibility depends oncharacteristics of human eyes. Among the characteristics of the humaneyes, the property of a visual field is classified into five kinds (see“Toyohiko HATADA(1993) Artificial reality and visual space perception,JAPAN Ergon Soc Vol. 29, No 3, p. 129-134”).

(1) discriminative visual field: a range in which visual functions, suchas vision and color discrimination, are excellent and information withhigh accuracy can be received (within several °)

(2) effective visual field: a range in which information is gazed onlywith eye movement and specific information can be received from theinside of noise instantly (within about 15° right-leftward, about 8°upward, about 12° downward)

(3) gaze-stabilized visual field: a range in which head movement occursin a state of supporting eye movement and gaze is possible reasonably(within 30 to 45° right-leftward, 20 to 30° upward, and 25 to 40°downward)

(4) guiding visual field: a range in which only identificationcapability to such an extent that the presence of presented informationcan be determined is provided, but a human sense of space coordinates isaffected (within 30 to 100° horizontal and 20 to 85° vertical)

(5) auxiliary visual field: a range in which information receptionextremely decreases and auxiliary work is performed to such an extentthat a gaze operation is induced with a strong stimulus or the like(within 100 to 200° horizontal and 85 to 135° vertical)

In recent years, a digital camera comprising an electronic view finderhas been increased. Accordingly, an imaging apparatus that can change aviewing angle of the electronic view finder based on a setting input ofa photographer in order to capture an image with higher quality is known(JP2010-016669A). In such an imaging apparatus, in a case where theviewing angle of the electronic view finder is expanded, a live viewimage is expanded fully inside the eyepiece window, through which thephotographer looks, and a sense of presence is provided. Then, it ispossible to obtain a captured image with high quality based on the liveview image with a sense of presence. In a case where the photographerlooks into the electronic view finder, an angle of the head with respectto the imaging apparatus is fixed. For this reason, while a target ishardly captured in an area where the angle exceeds 30° in a horizontaldirection, as the live view image is displayed in an area (theabove-described guiding visual field) exceeding the area, a sense ofpresence is provided.

SUMMARY OF THE INVENTION

However, in the imaging apparatus described in JP2010-016669A describedabove, in a case where the setting input is performed so as to expandthe viewing angle of the electronic view finder, it is advantageous inthat a sense of presence is provided in the live view image; however, asdescribed above, it is known that a viewing angle at which a human cangaze is limited. Accordingly, in a case where the photographer gazes aprincipal subject, there is a concern that an outside of the viewingangle at which the photographer can gaze, that is, a peripheral portionwithin the live view image is overlooked in exchange therefor.

In a case where there is movement in the peripheral portion within thelive view image, for example, when the photographer performs a panoperation or a tilt operation following the principal subject, when amoving object enters, or the like, even though an unnecessary object forthe photographer is present in the peripheral portion of the live viewimage, the photographer may perform imaging without noticing theunnecessary object. Alternatively, while it is considered that anobject, which may become a new principal subject for the photographer,is present in the peripheral portion of the live view image, thephotographer may gaze and image only the original principal subjectwithout noticing the object.

On the other hand, in the imaging apparatus described in JP2010-016669A,in a case where the viewing angle of the electronic view finder isnarrowed, the photographer can notice a situation of the peripheralportion, an object, which enters the peripheral portion, or the like ina case where there is movement in the peripheral portion within the liveview image. Instead, imaging cannot be performed to provide a sense ofpresence.

An object of the invention is to provide an imaging apparatus capable ofproviding a sense of presence in a live view image and allowing aphotographer to notice movement in a peripheral portion within the liveview image, and a control method and a control program therefor.

In order to achieve the above-described object, the invention providesan imaging apparatus comprising an imaging unit, a finder display unit,a movement vector detection unit, and a display range change unit. Theimaging unit images a subject to generate a captured image. The finderdisplay unit displays a live view image based on the captured imagegenerated by the imaging unit. The movement vector detection unitdetects a movement vector between frames in the captured image or thelive view image for a predetermined portion in the captured image. Thedisplay range change unit changes a display range of the live view imageon the finder display unit based on the movement vector of a peripheralportion in the captured image detected by the movement vector detectionunit.

It is preferable that the imaging apparatus further comprises aprincipal subject image recognition unit that recognizes a principalsubject image present in the captured image, the movement vectordetection unit detects the movement vector of the principal subjectimage in a case where the principal subject image is recognized by theprincipal subject image recognition unit, and the display range changeunit compares an amount of movement based on the movement vector of theperipheral portion with an amount of movement based on the movementvector of the principal subject image and reduces the display range in acase where the amount of movement based on the movement vector of theperipheral portion is greater than the amount of movement based on themovement vector of the principal subject image.

It is preferable that the display range change unit reduces the displayrange in a case where an amount of movement based on the movement vectorof the peripheral portion is equal to or greater than a predeterminedvalue.

It is preferable that the imaging apparatus further comprises a speeddetection unit that detects a speed of a pan operation or a tiltoperation, and the display range change unit changes a reduction rate ofthe display range according to the speed detected by the speed detectionunit.

It is preferable that the imaging apparatus further comprises a displaycontrol unit that makes imaging information relating to an imagingcontent of the imaging unit be displayed around the display range on thefinder display unit, and in a case where the display range change unitreduces the display range, the display control unit makes the imaginginformation be displayed on a magnified scale compared to before thereduction of the display range.

It is preferable that the imaging apparatus further comprises a speeddetection unit that detects a speed of a pan operation or a tiltoperation, the display range change unit changes a reduction rate of thedisplay range according to the speed detected by the speed detectionunit, and the display control unit changes a magnification rate of theimaging information according to the speed.

It is preferable that the imaging unit comprises an optical system thatis able to change an angle of view, and the display range change unitchanges a reduction rate of the display range according to the angle ofview.

It is preferable that a reduction rate of the display range is changedaccording to a portion in the peripheral portion where the movementvector is detected.

The invention also provides a control method for an imaging apparatuscomprising an imaging unit and a finder display unit. The control methodcomprises a step of detecting a movement vector between frames in thecaptured image or the live view image for a peripheral portion in thecaptured image, and a step of changing a display range of the live viewimage on the finder display unit based on the movement vector of theperipheral portion detected by the movement vector detection unit.

The invention also provides a control program for an imaging apparatuscomprising an imaging unit and a finder display unit. The controlprogram causes the imaging apparatus to execute a step of detecting amovement vector between frames in the captured image or the live viewimage for a peripheral portion in the captured image, and a step ofchanging a display range of the live view image on the finder displayunit based on the movement vector of the peripheral portion detected bythe movement vector detection unit.

According to the invention, it is possible to provide a sense ofpresence in a live view image, and to allow a photographer to noticemovement in a peripheral portion within the live view image.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a perspective view showing an appearance of a digital camerafrom a front surface side.

FIG. 2 is a perspective view showing the appearance of the digitalcamera from a rear surface side.

FIG. 3 is a block diagram showing the configuration of the digitalcamera.

FIG. 4 is an explanatory view showing an example of a captured imagethat is displayed on a finder display unit.

FIG. 5 is an explanatory view showing an example of a peripheral portionP in a captured image where a movement vector is detected.

FIG. 6 is a flowchart illustrating processing in displaying a live viewimage under an imaging mode.

FIG. 7 is an example of a display screen of the live view image and isan explanatory view showing before and after change in a case ofreducing a display range of the live view image.

FIG. 8 is an explanatory view showing before and after change in a caseof reducing the display range of the live view image and displayingimaging information on a magnified scale in a second embodiment.

FIG. 9 is a block diagram showing the configuration of a digital camerain a third embodiment.

FIG. 10 is an explanatory view showing an example of changing areduction rate of the display range according to a speed of a panoperation or a tilt operation.

FIG. 11 is a flowchart illustrating processing in displaying a live viewimage under an imaging mode in a fourth embodiment.

FIG. 12 is an example of a display screen of the live view image in thefourth embodiment and is an explanatory view showing before and afterchange in a case of reducing a display range of the live view image.

FIG. 13 is an example of the display screen of the live view image in afifth embodiment, in which a reduction rate is changed according to aportion where a movement vector is detected, and is an explanatory viewshowing before and after change in a case of reducing the display rangeof the live view image.

FIG. 14 is an example of the display screen of the live view image, onwhich a portion where a movement vector is detected, is displayed in ameshed manner.

FIG. 15 is an example of the display screen of the live view image onwhich the portion where the movement vector is detected is displayed ina meshed manner in a block unit.

DESCRIPTION OF THE PREFERRED EMBODIMENTS First Embodiment

In FIGS. 1 and 2, a digital camera 11 comprises a camera body 12(apparatus body), a lens barrel 13, a rear display unit 14, and a finderunit 15.

The lens barrel 13 is provided on a front surface of the camera body 12,and holds an imaging optical system 16. A focus ring 17, a stop ring 18,and a zoom ring 19 are provided on an outer periphery of the lens barrel13.

The rear display unit 14 is provided on a rear surface of the camerabody 12 and is used for playback of a captured image, display of a liveview image, display of a setting menu, and the like. The rear displayunit 14 is constituted of, for example, an LCD panel. A touch panel 29(see FIG. 3) is attached to a surface of the rear display unit 14, andan input instruction from the touch panel 29 is transmitted to a maincontrol unit 41.

A power lever 21, a release switch 22, an exposure correction dial 23, ashutter speed dial 24, an ISO sensitivity dial 26, an internal flashdevice 27, and the like are provided on an upper surface of the camerabody 12. A plurality of operation buttons 28 are provided on the rearsurface of the camera body 12. A plurality of operation buttons 28 areused for various setting operations and the like.

The digital camera 11 can switch an operation mode among imaging mode(static image or video imaging mode), a playback mode, and a settingmode through an operation of the operation buttons 28.

The power lever 21 is operated in turning on or off a power source (notshown) of the digital camera 11. The release switch 22 is operated inperforming imaging. The shutter speed dial 24 is operated in switching ashutter speed of the digital camera 11.

The release switch 22 a two-stage stroke type switch (not shown)constituted of an S1 switch and an S2 switch. The digital camera 11performs an imaging preparation operation, such as automatic exposureadjustment, in a case where the release switch 22 is depressed (halfdepression) and the S1 switch is brought into an on state. In a casewhere the release switch 22 is further depressed (full depression) fromthis state and the S2 switch is brought into an on state, an imagingoperation is performed.

In a bottom portion of the camera body 12, a slot (not shown) formounting a recording medium 52 (see FIG. 3) described below and aloading lid (not shown) for opening and closing an aperture of the slotare provided.

The finder unit 15 is an electronic view finder, and a live view imagedescribed below is displayed on a finder display unit 31 (see FIG. 3)constituted of an LCD disposed at the back of a finder eyepiece window15A. An eye of a photographer contacts the finder eyepiece window 15Adisposed on the rear surface side of the camera body 12.

In FIG. 3, the imaging optical system 16 comprises a plurality of lensesincluding a variable magnification lens 16A and a focus lens 16B, a stopunit 32, and the like. A shutter unit 33 and an imaging element 34 aredisposed behind the imaging optical system 16 along an optical axis LAof the imaging optical system 16. The imaging element 34 is providedinside the camera body 12.

A zoom mechanism 35 is a manual zoom mechanism that converts a rotationoperation of the zoom ring 19 to a linear movement to move the variablemagnification lens 16A. The variable magnification lens 16A is moved ina direction of the optical axis LA with driving of the zoom mechanism 35and changes an angle of view of the imaging optical system 16.

The focus lens 16B is moved in the direction of the optical axis LA withdriving of a motor 36 and adjusts an imaging distance. The main controlunit 41 transmits a control signal for moving the focus lens 16B to amotor driver 39 according to a rotation direction and an amount ofrotation of the focus ring 17 detected based on a signal of a detectionunit (not shown). The motor driver 39 drives the motor 36 based on thecontrol signal.

The stop unit 32 moves a plurality of stop leaf blades 32 a with drivingof a motor 37 and changes an amount of light incident on the imagingelement 34. The optical image of the subject that is transmitted throughthe imaging optical system 16 and has an amount of light adjusted by astop 30 is incident on the imaging element 34. The main control unit 41transmits a control signal for moving the stop leaf blades 32 a to themotor driver 39 according to an angle position of the stop ring 18detected based on a signal of a detection unit (not shown). The motordriver 39 drives the motor 37 based on the control signal.

The shutter unit 33 is a mechanical shutter, such as a focal planeshutter, and is disposed between the stop unit 32 and the imagingelement 34. The shutter unit 33 is provided to shut off an optical pathbetween the imaging optical system 16 and the imaging element 34, andchanges between an aperture open state and an aperture closed state.

The shutter unit 33 is brought into the aperture open state at the timeof live view image and video capturing. The shutter unit 33 istemporarily brought into the aperture closed state from the apertureopen state at the time of static image capturing. The shutter unit 33 isdriven by a motor 38. The main control unit 41 transmits a controlsignal for operating the shutter unit 33 to the motor driver 39according to setting information of a shutter system described below.The motor driver 39 drives the motor 38 based on the control signal.

The imaging element 34 is driven and controlled by the main control unit41. The imaging element 34 constitutes an imaging unit along with theshutter unit 33, the digital signal processing unit 44, and the like. Ina case of flash imaging using the internal flash device 27, the internalflash device 27 also constitutes the imaging unit. The imaging element34 is, for example, a single-plate color imaging type CMOS image sensorhaving an RGB color filter. The imaging element 34 has a light receivingsurface constituted of a plurality of pixels (not shown) arranged in atwo-dimensional matrix. Each pixel includes a photoelectric conversionelement, and captures the subject image formed on the light receivingsurface by the imaging optical system 16 through photoelectricconversion to generate an imaging signal. The imaging element 34 has anelectronic shutter function, and a shutter speed (electric chargeaccumulation time) thereof can be adjusted.

The imaging element 34 comprises signal processing circuits (all are notshown), such as a noise elimination circuit, an automatic gaincontroller, and an AID conversion circuit. The noise elimination circuitexecutes noise elimination processing on the imaging signal. Theautomatic gain controller amplifies the level of the imaging signal toan optimum value. The A/D conversion circuit converts the imaging signalto a digital signal and outputs the digital signal from the imagingelement 34. An output signal of the imaging element 34 is image data(so-called RAW data) having one pixel value for each pixel.

The imaging element 34 and the main control unit 41 are connected to abus 42. In addition, a memory control unit 43, a digital signalprocessing unit 44, a medium control unit 46, a display control unit 47,a setting information storage unit 48, and a touch panel 29 areconnected to the bus 42.

A memory 49 for temporary storage, such as an SDRAM, is connected to thememory control unit 43. The memory control unit 43 inputs and storesimage data output from the imaging element 34 to the memory 49. Thememory control unit 43 outputs image data stored in the memory 49 to thedigital signal processing unit 44.

The finder unit 15 comprises a finder display unit 31 and an eyepieceoptical system 51. An image displayed on the finder display unit 31 ismagnified by the eyepiece optical system 51 and is observed by an eye ofthe photographer contacting the finder eyepiece window 15A.

In the digital camera 11, in a case where the imaging mode (static imageor video imaging mode) is selected as the operation mode, capturedimages generated from the imaging unit cyclically (several tens offrames every second) are output to the finder display unit 31 or therear display unit 14 through the display control unit 47 and arecontinuously displayed as a live view image (also referred to as a livepreview image) for composition confirmation. The photographer adjusts animaging direction or the angle of view of the imaging optical system 16(the amount of movement of the variable magnification lens 16A) whileviewing the live view image such that a desired composition is obtainedand performs a release operation (a depression operation of the releaseswitch 22) when the desired composition is obtained.

The digital signal processing unit 44 executes known image processing,such as matrix calculation, demosaic processing, y correction,brightness and color difference conversion, and resizing processing, onimage data input from the memory 49, and generates captured image databased on the pixel value of each pixel. The digital signal processingunit 44 is constituted of a digital signal processor (DSP). The displaycontrol unit 47 controls image display on the rear display unit 14 andthe finder display unit 31.

In the digital camera 11, in a case where the imaging mode (static imageor video imaging mode) is selected as the operation mode, the digitalsignal processing unit 44 functions as a movement vector detection unitthat detects a movement vector between frames in the live view image fora predetermined portion in the captured image. Specifically, the digitalsignal processing unit 44 calculates a movement vector for featurepoints of an i-th frame and an (i+1)th frame in the live view imagebased on the captured images generated from the imaging unit cyclically(several tens of frames every second). The movement vector indicatesmovement of a feature point similar to a feature point of a standardimage (in this case, the i-th frame) to any place of an image ofinterest ((i+1)th frame) using a vector having components of an amountof movement and a movement direction.

In the embodiment, in a case of functioning as the movement vectordetection unit, the digital signal processing unit 44 detects a movementvector of the principal subject image and a movement vector of aperipheral portion in the captured image. In a case of detecting themovement vector of the principal subject image, the digital signalprocessing unit 44 functions as a principal subject image recognitionunit that first recognizes the principal subject image present in thecaptured image. In a case of functioning as the principal subject imagerecognition unit, the digital signal processing unit 44 recognizes theprincipal subject image present in the captured image using a knownpattern matching method, a face detection method, or the like.

As shown in FIG. 4, in a case where a principal subject image M isrecognized, the digital signal processing unit 44 detects a movementvector V1 of the principal subject image M indicating movement from ani-th frame in a live view image to any place of an (i+1)th frame for afeature point set in advance in the recognized principal subject imageM, for example, an eye portion.

As shown in FIG. 5, in a case of detecting a movement vector of theperipheral portion P (a meshed range in the drawing) in the capturedimage from the live view image, for example, the digital signalprocessing unit 44 detects a plurality of feature points in theperipheral portion in the captured image, calculates a movement vectorindicating movement from the i-th frame to any place of the (i+1)thframe for each of a plurality of feature points, and detects an averagevalue of the calculated movement vectors for a plurality of featurepoints as a movement vector V2 of the peripheral portion P. As adetection method of a plurality of feature points in the peripheralportion in the captured image, for example, a predetermined color, agradation, a shape, or the like is detected as a feature point.

In regard to the peripheral portion P in the captured image where thedigital signal processing unit 44 detects the movement vector, when acase where the live view image is displayed in a maximum display rangedisplayable on the finder display unit 31, that is, a case where thelive view image is displayed to be largest inside the finder eyepiecewindow 15A, into which the photographer looks, is defined as a standard,the outside of a viewing angle, at which a human can gaze the live viewimage, is set as the peripheral portion P.

The digital signal processing unit 44 also functions as a display rangechange unit that changes a display range of the live view image on thefinder display unit 31 based on the movement vector of the peripheralportion P detected in a case of functioning as the movement vectordetection unit. In the embodiment, the digital signal processing unit 44compares an amount of movement based on the movement vector V2 of theperipheral portion P with an amount of movement based on the movementvector V1 of the principal subject image M, and in a case where theamount of movement based on the movement vector V2 of the peripheralportion P is greater than the amount of movement based on the movementvector V1 of the principal subject image M, performs control such thatthe display control unit 47 reduces the display range of the live viewimage on the finder display unit 31. In this case, the display range isreduced at a given reduction rate with respect to the maximum displayrange displayable on the finder display unit 31.

As described above, in a case where the digital signal processing unit44 reduces the display range of the live view image on the finderdisplay unit 31, a state in which the display range is reduced may bemaintained while the imaging mode is continued. In a case where apredetermined time has elapsed after the display range is reduced, adisplay range of an initial setting, for example, the maximum displayrange displayable on the finder display unit 31 may be returned.

On the other hand, in a case where the amount of movement based on themovement vector V2 of the peripheral portion P is less than the amountof movement based on the movement vector V1 of the principal subjectimage M, the display range of the live view image on the finder displayunit 31 is not changed, and the live view image is displayed in thedisplay range of the initial setting.

The medium control unit 46 controls recording and reading of image fileson and from the recording medium 52. The recording medium 52 is, forexample, a memory card embedded with a flash memory. The medium controlunit 46 records image data compressed by the digital signal processingunit 44 on the recording medium 52.

The setting information storage unit 48 stores setting informationincluding imaging information relating to imaging conditions of theimaging unit. In a case where the setting information is set or changedby an operation of the exposure correction dial 23, the shutter speeddial 24, the ISO sensitivity dial 26, the operation buttons 28, or thetouch panel 29, the main control unit 41 stores the setting informationin the setting information storage unit 48. The setting informationstorage unit 48 is constituted of a nonvolatile memory. As the settinginformation that is stored in the setting information storage unit 48,setting information regarding which of the finder display unit 31 andthe rear display unit 14 the live view image is displayed on in a casewhere the imaging mode is selected is also included.

In a case where the imaging mode is selected, the display control unit47 reads the imaging information from the setting information storageunit 48 and makes imaging information D be displayed around the displayrange of the live view image on the finder display unit 31. In theembodiment, in a case where the live view image is displayed in themaximum display range displayable on the finder display unit 31, thelive view image is displayed over the entire width of the finder displayunit 31. Thus, the imaging information D is displayed in an empty spaceon an upper or lower side of the finder display unit 31 so as not tointerfere with the live view image.

As shown in FIGS. 4 and 5, as the imaging information D that isdisplayed on the finder display unit 31, a focus mode, a shutter speed,a stop, ISO sensitivity, dynamic range setting, the number of capturableimages, and the like are included.

A processing procedure for displaying the live view image under theimaging mode in the digital camera 11 will be described along aflowchart shown in FIG. 6 and an example of a display screen of a liveview image shown in FIG. 7.

In a case where the imaging mode is selected in the digital camera 11,the main control unit 41 first reads the setting information includingvarious kinds of imaging information from the setting informationstorage unit 48 (51).

The main control unit 41 starts the operation of the imaging unit basedon various kinds of read imaging information. In a case where theimaging unit starts the operation, a subject image is incident on thelight receiving surface of the imaging element 34 through the imagingoptical system 16, and image data is output from the imaging unit. In acase where image data is output from the imaging unit to the digitalsignal processing unit 44, the main control unit 41 confirms the settinginformation regarding which of the finder display unit 31 and the reardisplay unit 14 the live view image is displayed on, and in a case wherethe live view image is selected to be displayed on the finder displayunit 31 (in S2, Y), performs control such that the digital signalprocessing unit 44 displays the live view image in the display range ofthe finder display unit 31.

In the example shown in FIG. 7, in a state of the initial setting beforethe digital signal processing unit 44 functions as the display rangechange unit, the live view image is displayed in a maximum display rangeE0 displayable on the finder display unit 31. With this, thephotographer provides a sense of presence in the live view image. Then,the digital signal processing unit 44 recognizes the principal subjectimage from the captured image in the live view image displayed on thefinder display unit 31 (S3).

In a case where the live view image is not selected to be displayed onthe finder display unit 31 in the setting information (in S2, N), themain control unit 41 performs control such that the display control unit47 makes the rear display unit 14 display the live view image (S4).

The digital signal processing unit 44 that recognizes the principalsubject image M next detects the movement vector V1 of the principalsubject image M in the live view image based on the recognized principalsubject image M (S5). The digital signal processing unit 44 detects themovement vector V2 of the peripheral portion P in the captured image inthe live view image (S6).

In the example shown in FIG. 7, the principal subject image M is movedin the live view image, and a building or the like is moving in theperipheral portion P. That is, the photographer is performing a panoperation, a tilt operation, or the like while gazing the principalsubject in order to follow the principal subject. As described above, inthe state of the initial setting, since the live view image is displayedin the maximum display range E0 displayable on the finder display unit31, the outside of the viewing angle, at which the photographer cangaze, that is, the peripheral portion P is apt to be overlooked.

The digital signal processing unit that detects the movement vector V1of the principal subject image M and the movement vector V2 of theperipheral portion P in the live view image next compares the amount ofmovement based on the movement vector V2 of the peripheral portion Pwith the amount of movement based on the movement vector V1 of theprincipal subject image M (S7). Then, in a case where the amount ofmovement based on the movement vector V2 of the peripheral portion P isgreater than the amount of movement based on the movement vector V1 ofthe principal subject image M (in S7, Y), control is performed such thatthe display control unit 47 reduces a display range E1 of the live viewimage on the finder display unit 31 (S8). In the example shown in FIG.7, the live view image is displayed in the display range E1 obtained byreducing longitudinal and lateral dimensions at a given reduction rate,for example, 80% with respect to the maximum display range E0displayable on the finder display unit 31.

On the other hand, in a case where the amount of movement based on themovement vector V2 of the peripheral portion P is equal to or less thanthe amount of movement based on the movement vector V1 of the principalsubject image M (in S8, N), the display range E1 of the live view imageon the finder display unit 31 is not changed, and the live view image isdisplayed in the maximum display range E0 displayable on the finderdisplay unit 31 (S9).

In a case of continuing the imaging mode (in S10, Y), the processreturns to S1, and the display of the live view image, the detection ofthe movement vectors, the change of the display range E1, and the likeare repeated. The photographer adjusts an imaging direction or an angleof view while viewing the live view image such that a desiredcomposition is obtained and performs a release operation when thedesired composition is obtained. In a case of not continuing the imagingmode (in S10, N), the operation mode of the digital camera 11 is changedor a power source is brought into an off state, and imaging ends.

As described above, in a case where the amount of movement based on themovement vector V2 of the peripheral portion P is greater than theamount of movement based on the movement vector V1 of the principalsubject image M, the display range E1 is reduced. Thus, even though thephotographer gazes the principal subject, it is possible to allow thephotographer to notice movement in the peripheral portion within thelive view image. Before the display range E1 is reduced, or the like,the live view image is displayed in the maximum display range E0, and itis possible to obtain the live view image with a sense of presence.

Second Embodiment

In a second embodiment described below, in a case where the amount ofmovement based on the movement vector of the peripheral portion in thecaptured image is greater than the amount of movement based on themovement vector of the principal subject image, the display range of thelive view image on the finder display unit is reduced, and the imaginginformation is displayed on the finder display unit on a magnifiedscale.

As shown in FIG. 8, in the state of the initial setting, the displaycontrol unit 47 makes the imaging information D relating to the imagingconditions of the imaging unit be displayed around the maximum displayrange E0 on the finder display unit 31. In this case, as in theabove-described first embodiment, since the live view image is displayedover the entire width of the finder display unit 31, the imaginginformation D is displayed in an empty space on the upper side or thelower side of the finder display unit 31 so as not to interfere with thelive view image.

Then, in a case where the digital signal processing unit 44 as thedisplay range change unit reduces the display range E1 of the live viewimage, the display control unit 47 makes the imaging information D bedisplayed on a magnified scale compared to before the reduction of thedisplay range E1. In this case, in the finder display unit 31, since aspace on each of the upper side and the lower side of the display rangeE1 is expanded, and a space occurs on a right side and a left side, theimaging information D is displayed on a magnified scale using the spaceon each of the upper side, the lower sides, the right side, and the leftside of the display range E1.

A flow of processing from the start of the imaging mode until thedisplay range E1 of the live view image is reduced is the same as in theabove-described first embodiment. Similarly, the display range E1 isreduced at the given reduction rate with respect to the maximum displayrange E0.

Third Embodiment

In the respective embodiments described above, although an examplewhere, in a case where the amount of movement based on the movementvector of the peripheral portion in the captured image is greater thanthe amount of movement based on the movement vector of the principalsubject image, the display range of the live view image on the finderdisplay unit is reduced at a given reduction rate has been described,the invention is not limited thereto. In a third embodiment describedbelow, a speed of a pan operation or a tilt operation is detected, andthe reduction rate of the display range is changed according to thedetected speed of the pan operation or the tilt operation. In this case,as shown in FIG. 9, a digital camera 55 comprises a speed detection unit56. The configurations other than the speed detection unit 56 are thesame as those in the respective embodiments described above.

The speed detection unit 56 is constituted of a general accelerationsensor, an angular velocity sensor, or the like, and is fixed to thecamera body 12 or the lens barrel 13. The invention is not limitedthereto, and any unit may be applied as long as the unit can detect thespeed of the pan operation or the tilt operation of the digital camera55.

As shown in FIG. 10, the digital signal processing unit 44 changes thereduction rate of the display range E1 with respect to the maximumdisplay range E0 according to the speed detected by the speed detectionunit 56. Specifically, the reduction rate of the display range E1 withrespect to the maximum display range E0 decreases to, for example, 90%,80%, 70%, and 60% in a stepwise manner in inverse proportion to thedetected speed of the pan operation or the tilt operation.

In a case where the digital camera 55 displays the live view image onthe finder display unit 31, as in the above-described embodiments, theamount of movement based on the movement vector V2 of the peripheralportion P is compared with the amount of movement based on the movementvector V1 of the principal subject image M. Then, in a case where theamount of movement based on the movement vector V2 of the peripheralportion P is greater than the amount of movement based on the movementvector V1 of the principal subject image M, control is performed thatthe display control unit 47 reduces the display range E1 of the liveview image on the finder display unit 31. In this way, in reducing thedisplay range E1, the display range E1 is reduced at the reduction ratein inverse proportion to the speed of the pan operation or the tiltoperation described above.

When the photographer performs the pan operation or the tilt operationon the digital camera 55 in order to follow the principal subject, thephotographer gazes centering on the principal subject. Accordingly, theviewing angle is narrowed, and a range in which the photographer cangaze is more narrowed as the speed of the pan operation or the tiltoperation is higher. In the embodiment, since the display range E1 isreduced at the reduction rate in inverse proportion to the speed of thepan operation or the tilt operation, even though a range in which thephotographer can gaze is narrowed, it is possible to allow thephotographer to notice movement in the peripheral portion P within thelive view image.

In the third embodiment, although the reduction rate of the displayrange is changed according to the speed of the pan operation or the tiltoperation, the invention is not limited thereto, and the reduction rateof the display range may be changed according to the angle of view ofthe imaging optical system 16. In this case, for example, the digitalcamera comprises a position detection unit that detects a position ofthe variable magnification lens 16A is provided, and the digital signalprocessing unit 44 changes the reduction rate of the display range E1with respect to the maximum display range E0 according to the angle ofview of the imaging optical system 16 based on the position of thevariable magnification lens 16A detected by the position detection unit.With this, the angle of view of the imaging optical system 16 becomessmall (the focal length is extended), and even though the range in whichthe photographer can gaze is narrowed, it is possible to allow thephotographer to notice movement in the peripheral portion within thelive view image.

Even in the third embodiment, in a case where the amount of movementbased on the movement vector of the peripheral portion in the capturedimage is greater than the amount of movement based on the movementvector of the principal subject image M, as in the second embodiment,the display range E1 of the live view image on the finder display unit31 may be reduced, and the imaging information D may be displayed on thefinder display unit 31 on a magnified scale. In this case, in a casewhere the reduction rate of the display range E1 is changed according tothe speed of the pan operation or the tilt operation or the angle ofview of the imaging optical system 16, a magnification rate of theimaging information D is changed according to the speed of the panoperation or the tilt operation or the angle of view of the imagingoptical system 16. In the example shown in FIG. 10, the imaginginformation D is displayed to be larger in a stepwise manner inproportion to the detected speed of the pan operation or the tiltoperation.

Fourth Embodiment

In the respective embodiments described above, although an example wherethe amount of movement based on the movement vector of the peripheralportion in the captured image is compared with the amount of movementbased on the movement vector of the principal subject image, and thedisplay range of the live view image on the finder display unit is areduced according to the result of comparison has been described, theinvention is not limited thereto. In a fourth embodiment describedbelow, in a case where the amount of movement based on the movementvector of the peripheral portion in the captured image is equal to orgreater than a predetermined value, the display range of the live viewimage is reduced regardless of the movement vector of the principalsubject image. In this case, in a case of functioning as the movementvector detection unit, the digital signal processing unit 44 detectsonly the movement vector of the peripheral portion in the capturedimage.

The digital signal processing unit 44 also functions as a display rangechange unit that changes the display range of the live view image on thefinder display unit 31 based on the movement vector of the peripheralportion P detected in a case of functioning as the movement vectordetection unit. In the embodiment, in a case where the amount ofmovement based on the movement vector V2 of the peripheral portion P isequal to or greater than the predetermined value, the digital signalprocessing unit 44 performs control such that the display control unit47 reduces the display range of the live view image on the finderdisplay unit 31. The configurations excluding the digital signalprocessing unit 44 functioning as the movement vector detection unit andthe display range change unit are the same as those in the digitalcamera 11 of the above-described first embodiment.

A processing procedure for displaying a live view image under theimaging mode in the digital camera, to which the embodiment is applied,will be described along a flowchart shown in FIG. 11 and an example of adisplay screen of a live view image shown in FIG. 12.

Under the imaging mode of the digital camera of the embodiment, the maincontrol unit 41 first reads the setting information including variouskinds of imaging information from the setting information storage unit48 (S21).

The main control unit 41 starts the operation of the imaging unit basedon various kinds of read imaging information. In a case where theimaging unit starts the operation, a subject image is incident on thelight receiving surface of the imaging element 34 through the imagingoptical system 16, and image data is output from the imaging unit. In acase where image data is output from the imaging unit to the digitalsignal processing unit 44, the main control unit 41 confirms the settinginformation regarding which of the finder display unit 31 and the reardisplay unit 14 the live view image is displayed on, and in a case wherethe live view image is selected to be displayed on the finder displayunit 31 (in S22, Y), performs control such that the digital signalprocessing unit 44 displays the live view image in the display range ofthe finder display unit 31.

In the example shown in FIG. 12, in a state of the initial settingbefore the digital signal processing unit 44 functions as the displayrange change unit, the live view image is displayed in a maximum displayrange E0 displayable on the finder display unit 31. Then, the digitalsignal processing unit 44 detects the movement vector V2 of theperipheral portion P in the captured image in the live view image (S23).

In a case where the live view image is not selected to be displayed onthe finder display unit 31 in the setting information (in S22, N), themain control unit 41 performs control such that the display control unit47 makes the rear display unit 14 display the live view image (S24).

In the example shown in FIG. 12, the principal subject image M is movedin the live view image, and a building or the like is moving in theperipheral portion P. That is, the photographer is performing a panoperation, a tilt operation, or the like while gazing the principalsubject in order to follow the principal subject. In the example shownin FIG. 12, a flying helicopter is exemplified as the principal subjectimage M and is moving while a blade portion is rotated at a high speed,and in a case where the movement vector of the principal subject image Mis detected, and the amount of movement is likely to be a large value.

The digital signal processing unit that detects the movement vector V2of the peripheral portion Pin the live view image next compares theamount of movement based on the movement vector V2 of the peripheralportion P with the predetermined value (S5). Then, in a case where theamount of movement based on the movement vector V2 of the peripheralportion P is equal to or greater than a predetermined value (in S25, Y),control is performed such that the display control unit 47 reduces thedisplay range E1 of the live view image on the finder display unit 31(S26). In the example shown in FIG. 12, the live view image is displayedin the display range E1 obtained by reducing the longitudinal andlateral dimensions at a given reduction rate, for example, 80% withrespect to the maximum display range E0 displayable on the finderdisplay unit 31.

On the other hand, in a case where the amount of movement based on themovement vector V2 of the peripheral portion P is less than thepredetermined value (in S25, N), the display range of the live viewimage on the finder display unit 31 is not changed, and the live viewimage is displayed in the maximum display range displayable on thefinder display unit 31 (S27).

In a case of continuing the imaging mode (in S28, Y), the processreturns to S21, and the display of the live view image, the detection ofthe movement vector, the change of the display range, and the like arerepeated. The photographer adjusts an imaging direction or an angle ofview while viewing the live view image such that a desired compositionis obtained and performs a release operation when the desiredcomposition is obtained. In a case of not continuing the imaging mode(in S28, N), the operation mode of the digital camera is changed or thepower source is brought into the off state, and imaging ends.

As described above, in a case where the amount of movement based on themovement vector V2 of the peripheral portion P is equal to or greaterthan a predetermined value, the display range E1 is reduced. Thus, eventhough the photographer gazes the principal subject, it is possible toallow the photographer to notice movement in the peripheral portionwithin the live view image. Before the display range of the live viewimage on the finder display unit 31 is reduced, or the like, the liveview image is displayed in the maximum display range E0, and it ispossible to obtain the live view image with a sense of presence.

In the configuration of the above-described first embodiment, the amountof movement based on the movement vector of the principal subject imageM is compared with the amount of movement based on the movement vectorof the peripheral portion P, and the display range E1 is reducedaccording to the result of comparison. Thus, as in the example shown inFIG. 12, the amount of movement based on the movement vector of theprincipal subject image M that moves fast, such as a helicopter, anautomobile, or a bird, is greater than the amount of movement based onthe movement vector of the peripheral portion P. Therefore, even thoughthere is movement in the peripheral portion P, the display range E1 maynot be reduced. In contrast, in the embodiment, since only the amount ofmovement based on the movement vector of the peripheral portion P iscompared with the predetermined value, it is possible to allow thephotographer to notice movement in the peripheral portion within thelive view image.

Even in the fourth embodiment, in a case where the amount of movementbased on the movement vector V2 of the peripheral portion P is equal toor greater than a predetermined value, as in the second embodiment, thedisplay range E1 of the live view image on the finder display unit 31may be reduced, and the imaging information D may be displayed on thefinder display unit 31 on a magnified scale. Alternatively, as in thethird embodiment, the reduction rate of the display range may be changedaccording to the speed of the pan operation or the tilt operation or theangle of view of the imaging optical system 16.

Fifth Embodiment

In the above-described fourth embodiment, although an example where, ina case where the amount of movement based on the movement vector of theperipheral portion P is equal to or greater than a predetermined value,the display range of the live view image on the finder display unit isreduced at the given reduction rate has been described, the invention isnot limited. In a fifth embodiment described below, the reduction rateis changed according to a portion, in which the movement vector isdetected, in the peripheral portion P within the captured image in thelive view image displayed on the finder display unit 31. In this case,for example, as shown in FIG. 13, the peripheral portion P is dividedinto two portions P1 and P2 of an outside and an inside (in thefollowing description, referred to as an outer peripheral portion P1 andan inner peripheral portion P2, respectively). Then, the reduction rateis changed in a case where a portion S in the peripheral portion P wherethe movement vector is detected is present only in the outer peripheralportion P1 and in a case where the portion S is present in the innerperipheral portion P2.

In a case where the portion S (a position indicated by a solid line)where the movement vector is detected is present only in the outerperipheral portion P1, the digital signal processing unit 44 sets thereduction rate of the display range E1 with respect to the maximumdisplay range E0 to, for example, 80%. On the other hand, in a casewhere the portion S (a position indicated by a broken line) where themovement vector is detected is present in the inner peripheral portionP2, the digital signal processing unit 44 sets the reduction rate of thedisplay range E1 with respect to the maximum display range E0 to besmaller, for example, 60%.

When the photographer performs the pan operation or the tilt operationon the digital camera in order to follow the principal subject, thephotographer gazes centering on the principal subject. Thus, the viewingangle is narrowed, and in a case where the portion S where the movementvector is detected is present not only in the outer peripheral portionP1 but also in the inner peripheral portion P2, it is considered thatthe range in which the photographer can gaze is narrowed. In theembodiment, in a case where the portion S (the position indicated by thebroken line) where the movement vector is detected is present in theinner peripheral portion P2, the reduction rate of the display range E1with respect to the maximum display range E0 is smaller. Thus, eventhough the range in which the photographer can gaze is narrowed, it ispossible to allow the photographer to notice movement in the peripheralportion within the live view image.

In the example shown in FIG. 13, although an example where theperipheral portion P is divided into the two portions, and the reductionrate of the display range E1 with respect to the maximum display rangeE0 is changed in the two steps according to the portion S where themovement vector is detected has been described, the invention is notlimited thereto. The peripheral portion may be divided into three ormore portions, and the number of steps in which the reduction rate ofthe display range E1 with respect to the maximum display range E0 may bechanged may be increased according to the number of divided portions.

In order to allow the photographer to easily notice the portion S wherethe movement vector is detected, as shown in FIGS. 14 and 15, theportion S where the movement vector is detected may be displayed to bedifferent from a portion therearound, for example, in a meshed manner.FIG. 14 shows a case where only the portion where the movement vector isdetected is displayed in a meshed manner, and FIG. 15 shows a case wherethe peripheral portion P is divided into rectangular blocks, and a blockwhere the movement vector is detected is displayed in a meshed manner.The display of the portion S where the movement vector is detected isnot limited thereto, and the portion S where the movement vector isdetected may be displayed to be different from a portion therearound,such as inverting colors or blinking.

In the respective embodiments described above, although the digitalsignal processing unit 44 detects the movement vector between the framesin the live view image in a case of functioning as the movement vectordetection unit, the invention is not limited thereto, and the movementvector between the frames in the captured images generated cyclicallyfrom the imaging unit may be detected. In this case, as in therespective embodiments described above, the display range of the liveview image on the finder display unit is changed based on the movementvector detected from the captured images.

In the respective embodiments described above, the imaging element 34 isa CMOS type image sensor, but may be a CCD type image sensor. In therespective embodiments described above, the finder unit is an electronicview finder, but may be a hybrid view finder. In the respectiveembodiments described above, although the internal flash device is used,an external flash device may be used.

The invention can be applied to an imaging apparatus, such as asmartphone or a video camera, in addition to the digital camera.

EXPLANATION OF REFERENCES

-   -   11: digital camera    -   12: camera body    -   13: lens barrel    -   14: rear display unit    -   15: finder unit    -   15A: finder eyepiece window    -   16: imaging optical system    -   16A: variable magnification lens    -   16B: focus lens    -   17: focus ring    -   18: stop ring    -   19: zoom ring    -   21: power lever    -   22: release switch    -   23: exposure correction dial    -   24: shutter speed dial    -   26: sensitivity dial    -   27: internal flash device    -   28: operation button    -   29: touch panel    -   31: finder display unit    -   32: stop unit    -   32 a: stop leaf blade    -   33: shutter unit    -   34: imaging element    -   35: zoom mechanism    -   36, 37, 38: motor    -   39: motor driver    -   41: main control unit    -   42: bus    -   43: memory control unit    -   44: digital signal processing unit    -   46: medium control unit    -   47: display control unit    -   48: setting information storage unit    -   49: memory    -   51: eyepiece optical system    -   52: recording medium    -   55: digital camera    -   56: speed detection unit

What is claimed is:
 1. An imaging apparatus comprising: an imager thatimages a subject to generate a captured image; a finder display thatdisplays a live view image based on the captured image generated by theimager; and a processor configured to perform: a movement vectordetection function that detects a movement vector between frames in thecaptured image or the live view image for a predetermined portion in thecaptured image; and a display range change function that changes adisplay range of the live view image on the finder display based on themovement vector of a peripheral portion in the captured image detectedby the movement vector detection function.
 2. The imaging apparatusaccording to claim 1, wherein the processor further configured toperform: a principal subject image recognition function that recognizesa principal subject image present in the captured image, wherein themovement vector detection function detects the movement vector of theprincipal subject image in a case where the principal subject image isrecognized by the principal subject image recognition function, and thedisplay range change function compares an amount of movement based onthe movement vector of the peripheral portion with an amount of movementbased on the movement vector of the principal subject image and reducesthe display range in a case where the amount of movement based on themovement vector of the peripheral portion is greater than the amount ofmovement based on the movement vector of the principal subject image. 3.The imaging apparatus according to claim 1, wherein the display rangechange function reduces the display range in a case where an amount ofmovement based on the movement vector of the peripheral portion is equalto or greater than a predetermined value.
 4. The imaging apparatusaccording to claim 2, wherein the processor further configured toperform: a speed detection function that detects a speed of a panoperation or a tilt operation, wherein the display range change functionchanges a reduction rate of the display range according to the speeddetected by the speed detection function.
 5. The imaging apparatusaccording to claim 2, wherein the processor further configured toperform: a display control function that makes imaging informationrelating to an imaging content of the imager be displayed around thedisplay range on the finder display, wherein, in a case where thedisplay range change function reduces the display range, the displaycontrol function makes the imaging information be displayed on amagnified scale compared to before the reduction of the display range.6. The imaging apparatus according to claim 5, wherein the processorfurther configured to perform: a speed detection function that detects aspeed of a pan operation or a tilt operation, wherein the display rangechange function changes a reduction rate of the display range accordingto the speed detected by the speed detection function, and the displaycontrol function changes a magnification rate of the imaging informationaccording to the speed.
 7. The imaging apparatus according to claim 2,wherein the imager comprises an optical system that is able to change anangle of view, and the display range change function changes a reductionrate of the display range according to the angle of view.
 8. The imagingapparatus according to claim 3, wherein a reduction rate of the displayrange is changed according to a portion in the peripheral portion wherethe movement vector is detected.
 9. A control method for an imagingapparatus comprising an imager that images a subject to generate acaptured image, and a finder display that displays a live view imagebased on the captured image generated by the imager, the control methodcomprising: a step of detecting a movement vector between frames in thecaptured image or the live view image for a peripheral portion in thecaptured image; and a step of changing a display range of the live viewimage on the finder display based on the movement vector of theperipheral portion detected by the movement vector detection.
 10. Anon-transitory computer readable medium for storing acomputer-executable program for an imaging apparatus comprising animager that images a subject to generate a captured image, and a finderdisplay that displays a live view image based on the captured imagegenerated by the imager, the computer-executable program causing acomputer to execute: a step of detecting a movement vector betweenframes in the captured image or the live view image for a peripheralportion in the captured image; and a step of changing a display range ofthe live view image on the finder display based on the movement vectorof the peripheral portion detected by the movement vector detection.